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DETAILED ACTION 

This is a Final Office Action for Application no. 10/784,449 in response to the 
amendment filed on August 1 1 , 2008. 

Response to Arguments 

Applicant's arguments with respect to claims 1-10, 1 2-41 , and 43-55 have been 
considered but are moot in view of the new ground(s) of rejection. 

The Applicant argues US Patent 6,215,519 to Nayar teaches a visual perception 
algorithm as depicted in Figure 2 (Col 7 Lines 51-59). Therefore Applicant determines 
Nayar fails to teach the claim limitation "without application of at least one visual 
perception algorithm, to said video data". The Examiner respectfully disagrees. The 
rejection of the claims is based on the embodiment depicted in Figure 6, not the 
embodiment of Figure 2. Nayar specifically teaches the two embodiments are distinct 
(Col 5 Lines 40-42 and Lines 55-57). As shown in Figure 6, the Image processing unit 
of Figure 2 is not present. Further, the embodiment of Figure 6 does not provide the 
image data of the sensor (1 0) to a display. Therefore the image data provided by 
sensor 10 has not had the visual perception algorithm applied in order to provide a 
viewable image to a display. 

In regards to claims 18, 19, 49 and 50, the common knowledge or well-known in 
the art statement is taken to be admitted prior art because applicant either failed to 
traverse the examiner's assertion of official notice or that the traverse was inadequate. 
Claim Rejections - 35 USC § 103 
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The following is a quotation of 35 U.S.C. 1 03(a) which forms the basis for all 
obviousness rejections set forth in this Office action: 

(a) A patent may not be obtained though the invention is not identically disclosed or described as set 
forth in section 102 of this title, if the differences between the subject matter sought to be patented and 
the prior art are such that the subject matter as a whole would have been obvious at the time the 
invention was made to a person having ordinary skill in the art to which said subject matter pertains. 
Patentability shall not be negatived by the manner in which the invention was made. 

Claims 1,3-5, 7-10, 21, 31-33, 35-41, 51-53 and 55 are rejected under 35 U.S.C. 
103(a) as being unpatentable over US Patent 6,215,519 to Nayar et al. in view of 
[claims 1, 31, 40] 

As shown in Figure 6, Nayar teaches a video surveillance system for performing 
a method of monitoring a moving object. The system includes a video camera (20) and 
at least one motion detector (10). Nayar teaches the motion detector comprises a lens 
(1 1 0) having a field of view fixedly directed to an area of interest, and an imager (1 00) 
for receiving an image through said lens and converting said image to video data (Col 9 
Lines 35-37, Col 12 Line 62- Col 13 line 13, Fig. 8). Note, the lens is fixedly directed to 
an area of interest (Col 3 Lines 17-22, Col 7 Lines 1-7, Col 13 Lines 21-23). 

The motion detector is configured to monitor the video data for movement of an 
object in said field of view and to provide a detector output in response to said 
movement of said object, said detector output being configured to cause adjustment of 
at least one operating characteristic of said video camera to target said camera on said 
object (Col 9 Lines 37-45). Nayar further teaches the image received by the frame 
grabber has separate color channels (red, green, blue) (Col 10 Lines 36-42). The 
Applicant's specification defines one visual perception algorithm is color space 
correction (Bayer to RGB to YUV) (Page 7 Lines 1-12). It would be inherent that Nayar 
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does not perform the visual perception algorithm of color space correction since the 
motion detection is performed on separate color channels (red, green, blue) and not on 
a YUV signal. 

As shown in Figure 6, Nayar further teaches at least one recording device (52) 
including recording media (Col 10 Lines 1-4). Nayar further teaches the motion detector 
is configured to command the camera to independently track multiple moving objects by 
cycling between views of the targets (Col 9 Lines 38-61 ). Nayar further teaches the 
displaying or recording of the objects (Col 9 Line 65-Col 10 Line 3). Nayar is silent on 
the providing a recording command and the varying of the recording based on video 
activity. 

Egnal teaches a security system is used to record video from a camera for later 
viewing (Paragraph [0002]). Egnal further teaches a desired point to record is during a 
robbery in order to capture high-resolution video of the robber (Paragraph [0003]). 
Egnal teaches the use of a similar system to Nayar for spotting unusual activity and 
then using a PTZ camera to zoom in and record recognition and location information 
(Paragraph [0004]). It would have been obvious to one of ordinary skill in the art at the 
time of the invention to combine an indicator for recording as taught by Egnal with the 
system of Nayar in order to record recognition and location information of an unusual 
activity as taught by Egnal (Paragraph [0003]). Egnal is silent on the varying of the 
recording based on video activity. 

Enright discloses a security system wherein the recorder is adapted to adjust the 
compression and frame rate based on visual activity in order to obtain higher quality 
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images during events of interest (Col 1 Lines 9-16, Col 2 Line 45-54 and Col 15 Lines 1- 
20). It would have been obvious to one of ordinary skill in the art at the time of the 
invention to change the frame rate of the recorder of Nayar and Egnal in order to obtain 
higher quality images of important events as taught by Enright (Col 2 Lines 45-54). 
[claims 3, 33, and 41] 

Nayar teaches the use of a wide-angle lens (Col 1 3 Line 66-Col 1 4 Line 8). 
[claim 4] 

Nayar teaches the motion detector fixedly mounted to the video camera (Col 8 
Lines 26-29, Fig. 4). 
[claims 5 and 33] 

Nayar teaches the use of a ccd (Col 10 Line 56). 
[claims 7 and 35] 

Nayar teaches the use of a motion detect sequencer configured for monitoring 
said video data for said movement of said object (Col 9 Lines 40-41 , Col 1 1 Lines 8-1 8 
and Lines 48-66). 
[claims 8 and 36] 

Nayar further teaches the motion detector comprises a controller for receiving an 
output of said motion detect sequencer, said controller being configured to provide said 
detector output (Col 9 Lines 42-45). 
[claims 9 and 37] 

Nayar teaches the at least one operating characteristic comprises a pan, tilt, or 
zoom characteristic of the video camera (Col 3 Lines 23-27). 
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[claims 10 and 38] 

Nayar teaches the detector output is provided to modify a pan, tilt and zoom 
characteristic of the video camera (Col 3 Lines 23-27, Col 9 Lines 40-45). 
[claims 12 and 43] 

As shown above for claims 1 and 40, Nayar teaches the system of Figure 6 and 
method for the system. Nayar is silent on the use of a plurality of motion detectors. 

Egnal teaches a similar system to Nayar (Paragraphs [0001], [0006], Fig. 1). 
Egnal further teaches the use of multiple motion detectors for controlling a slave 
camera, in order to provide multiple types of cameras for the motion detector 
(Paragraph [0041]). Egnal further teaches the ability to control a single slave camera by 
multiple motion detectors in order to provide high resolution images of multiple objects 
of interest (Paragraph [0077]). It would have been obvious to one of ordinary skill in the 
art at the time of the invention to combine the multiple motion detectors of Egnal with 
the system of Nayar as Egnal teaches the benefit of using multiple motion detectors for 
providing multiple objects of interest to a single high resolution slave camera 
(Paragraph [0077]). 
[claims 13 and 44] 

Nayar is silent on the video data associated with the motion detectors is time 
multiplexed. 

Egnal teaches the use of multiple motion detectors which work together to 
provide broader spatial coverage and/or cooperative tracking of targets (Paragraph 
[0097]). Egnal teaches the video of the motion detectors is time multiplexed (Paragraph 
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[0098]). Note, it is viewed by the Examiner that the two motion detectors observing and 
tracking the same target at the same time is time multiplexed, 
[claim 14, 15, 45 and 46] 

Egnal further teaches the use of two motion detectors, where one acts as the 
master and the other acts as a slave. The motion detectors switch roles when an object 
of interest leaves the viewing area of the slave motion detector (Paragraph [0097]- 
[0098]). It would have been obvious to one of ordinary skill in the art at the time of the 
invention to use the motion detectors of Egnal with the system of Nayar in order to 
provide continued tracking as long as a target is in view for either motion detector 
(Paragraph [0098]). 
[claims 16, 17, 47 and 48] 

As shown above, Nayar and Egnal teach the system of claim 12 and method of 
claim 43. Nayar further teaches the placement of imagers for the motion detector are 
placed in a circular pattern providing a 360 degree field of view around a camera (Col 
14 Lines 9-15, Figs. 4, 15A and 15B). Nayar is silent on each imager being apart of 
different motion detectors. 

As shown in Figure 1 , Egnal teaches a similar system to Nayar (Paragraph 
[0038]). Egnal teaches each motion detector (master camera) comprises an imager 
and processing units (Paragraph [0059], Fig. 2). Egnal further teaches the use of a 
plurality of motion detectors used to control a single camera (Paragraph [0077]). It 
would have been obvious to one of ordinary skill in the art at the time of the invention to 
provide each imager of Nayar as part of a motion detector as Egnal teaches the use of 
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multiple motion detectors for solving the problem of controlling PTZ cameras in the prior 
art (Paragraph [0003]). 
[claims 18, 19, 49 and 50] 

As shown above, Nayar and Egnal teach the system of claim 12 and method of 
claim 43. Nayar further teaches the placement of the camera below the motion detector 
(Fig. 4). Nayar further teaches the motion detector may be placed in a ring pattern (Col 
14 Lines 9-14, Figs. 15A and 15B). Official Notice is taken that both the concept and 
advantages of annular ring are well known and expected in the art. Thus, it would have 
been obvious to one skilled in the art, at the time of the Applicant's invention, to provide 
an annular ring for mounting the motion detectors shown by Nayar in Figures 15A and 
1 5B as such a ring is well known in the art for mounting a plurality of sensors to provide 
a 360 degree field of view (Official Notice), 
[claim 20] 

Nayar teaches the controlling of the camera by a motion detector as described in 
the preferred embodiment of Figure 6. Nayar teaches an alternative embodiment where 
a human user controls the camera (Col 7 Lines 27-48, Fig. 2). Nayar is silent on the 
use of a motion detector and Human user for controlling the camera. 

Egnal teaches a similar system to Nayar wherein a camera is controlled by a 
motion detector (Paragraph [0038], Fig. 1). Egnal further teaches the use of a Human 
user input for controlling a camera when multiple motion detectors are used (Paragraph 
[0077]). It would have been obvious to one of ordinary skill in the art at the time of the 
invention to combine the Human user input of Egnal with the system of Nayar in order to 
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define priority to motion detectors when multiple motion detectors are used, as taught 
by Egnal (Paragraph [0077]). 
[claims 21, 39 and 51] 

Nayar teaches the imager is a low resolution imager compared to the camera 
(Col 3 Lines 17-22). 
[claim 22] 

As shown in Figure 6, Nayar teaches a video surveillance system. The system 
includes a video camera (20) and at least one motion detector (10). Nayar teaches the 
motion detector comprises a lens (110) having a field of view fixedly directed to an area 
of interest, and an imager (100) for receiving an image through said lens and converting 
said image to video data (Col 9 Lines 35-37, Col 12 Line 62- Col 13 line 13, Fig. 8). 
Note, the lens is fixedly directed to an area of interest (Col 3 Lines 17-22, Col 7 Lines 1- 
7, Col 13 Lines 21-23). 

The motion detector is configured to monitor the video data for movement of an 
object in said field of view and to provide a detector output in response to said 
movement of said object, said detector output being configured to cause adjustment of 
at least one operating characteristic of said video camera to target said camera on said 
object (Col 9 Lines 37-45). Nayar further teaches the image received by the frame 
grabber has separate color channels (red, green, blue) (Col 10 Lines 36-42). The 
Applicant's specification defines one visual perception algorithm is color space 
correction (Bayer to RGB to YUV) (Page 7 Lines 1-12). It would be inherent that Nayar 
does not perform the visual perception algorithm of color space correction since the 
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motion detection is performed on separate color channels (red, green, blue) and not on 
a YUV signal. 

Nayar teaches the at least one operating characteristic comprises a pan, tilt, or 
zoom characteristic of the video camera and is used to modify a pan tilt and zoom 
characteristic of the video camera (Col 3 Lines 23-27, Col 9 Lines 40-45). 

Nayar further teaches the ability to record to a recording media the video output 
by the camera (Col 10 Lines 1-9). Nayar teaches the use of such a system for 
surveillance (Col 1 Lines 14-17). Nayar is silent on a command to record. 

Egnal teaches a security system is used to record video from a camera for later 
viewing (Paragraph [0002]). Egnal further teaches a desired point to record is during a 
robbery in order to capture high-resolution video of the robber (Paragraph [0003]). 
Egnal teaches the use of a similar system to Nayar for spotting unusual activity and 
then using a PTZ camera to zoom in and record recognition and location information 
(Paragraph [0004]). It would have been obvious to one of ordinary skill in the art at the 
time of the invention to combine an indicator for recording as taught by Egnal with the 
system of Nayar in order to record recognition and location information of an unusual 
activity as taught by Egnal (Paragraph [0003]). 
[claim 24] 

Nayar teaches the motion detector fixedly mounted to the video camera (Col 8 
Lines 26-29, Fig. 4). 
[claim 25] 

Nayar teaches the use of a ccd (Col 10 Line 56). 
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[claim 27] 

Nayar teaches the use of a motion detect sequencer configured for monitoring 
said video data for said movement of said object (Col 9 Lines 40-41 , Col 1 1 Lines 8-1 8 
and Lines 48-66). 
[claim 28] 

Nayar further teaches the motion detector comprises a controller for receiving an 
output of said motion detect sequencer, said controller being configured to provide said 
detector output (Col 9 Lines 42-45). 
[claim 29] 

Nayar teaches the controlling of the camera by a motion detector as described in 
the preferred embodiment of Figure 6. Nayar teaches an alternative embodiment where 
a human user controls the camera (Col 7 Lines 27-48, Fig. 2). Nayar is silent on the 
use of a motion detector and Human user for controlling the camera. 

Egnal teaches a similar system to Nayar wherein a camera is controlled by a 
motion detector (Paragraph [0038], Fig. 1 ). Egnal further teaches the use of a Human 
user input for controlling a camera when multiple motion detectors are used (Paragraph 
[0077]). It would have been obvious to one of ordinary skill in the art at the time of the 
invention to combine the Human user input of Egnal with the system of Nayar in order to 
define priority to motion detectors when multiple motion detectors are used, as taught 
by Egnal (Paragraph [0077]). 
[claim 30] 
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Nayar teaches the imager is a low resolution imager compared to the camera 
(Col 3 Lines 17-22). 
[claim 52] 

As shown above for claim 40, Nayar teaches a method for monitoring a moving 
object. Nayar further teaches the ability to monitor multiple objects (Col 9 Lines 40-55). 
[claim 53] 

Nayar further teaches the use of a PTZ scheduling unit which inputs the objects 
being tracked and provides time sharing capabilities. The output of the PTZ scheduling 
unit is received by a PTZ driver which provides the commands to the camera in order to 
spend a predetermined amount of time on each object that is tracked (Col 9 Lines 46- 
64). 

[claim 55] 

Nayar teaches the use of a wide-angle lens (Col 13 Line 66-Col 14 Line 8). 

Claims 2, 6, 23, 26 and 34 are rejected under 35 U.S.C. 103(a) as being 
unpatentable over Nayar, Egnal and Enright in view of US Patent 6,830,38 to Kajino et 
al. 

[claims 2 and 23] 

Nayar, Egnal and Enright teach the surveillance systems of claims 1 and 22 as 
shown above. Nayar, Egnal and Enright are silent on the camera comprising a dome. 

Kajino teaches a controllable camera comprising a dome (Abstract, Col 9 Lines 
22-35). It would have been obvious to one of ordinary skill in the art at the time of the 
invention to include the controllable camera of Nayar within a dome as Kajino teaches 
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the use of a dome in a preferred embodiment of a controllable camera (Col 9 Lines 22- 
35). 

[claims 6, 26, and 34] 

Nayar teaches the imager is a ccd as shown above for claim 5 (Col 1 0 Line 56). 
Nayar, Egnal and Enright are silent on the use of a cmos imager. 

Kajino teaches cmos and ccd imagers may both be used for cameras (Col 5 
Lines 3-8). It would have been obvious to one of ordinary skill in the art at the time of 
the invention to use a cmos instead of a ccd as the imager for Nayar as Kajino teaches 
cmos and ccd are known imagers for cameras (Col 5 Lines 3-8). 

Conclusion 

Applicant's amendment necessitated the new ground(s) of rejection presented in 
this Office action. Accordingly, THIS ACTION IS MADE FINAL. See M PEP 

§ 706.07(a). Applicant is reminded of the extension of time policy as set forth in 37 
CFR 1.136(a). 

A shortened statutory period for reply to this final action is set to expire THREE 
MONTHS from the mailing date of this action. In the event a first reply is filed within 
TWO MONTHS of the mailing date of this final action and the advisory action is not 
mailed until after the end of the THREE-MONTH shortened statutory period, then the 
shortened statutory period will expire on the date the advisory action is mailed, and any 
extension fee pursuant to 37 CFR 1 .136(a) will be calculated from the mailing date of 
the advisory action. In no event, however, will the statutory period for reply expire later 
than SIX MONTHS from the date of this final action. 
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Any inquiry concerning this communication or earlier communications from the 
examiner should be directed to ERICK REKSTAD whose telephone number is 
(571)272-7338. The examiner can normally be reached on 8-5. 

If attempts to reach the examiner by telephone are unsuccessful, the examiner's 
supervisor, Mehrdad Dastouri can be reached on 571-272-7418. The fax phone 
number for the organization where this application or proceeding is assigned is 571- 
273-8300. 

Information regarding the status of an application may be obtained from the 
Patent Application Information Retrieval (PAIR) system. Status information for 
published applications may be obtained from either Private PAIR or Public PAIR. 
Status information for unpublished applications is available through Private PAIR only. 
For more information about the PAIR system, see http://pair-direct.uspto.gov. Should 
you have questions on access to the Private PAIR system, contact the Electronic 
Business Center (EBC) at 866-217-9197 (toll-free). If you would like assistance from a 
USPTO Customer Service Representative or access to the automated information 
system, call 800-786-9199 (IN USA OR CANADA) or 571-272-1000. 
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